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Experimental observation of nucleon instability is one of the missing key components reqnired 
for the explanation of baryon asymmetry of the nniverse. Proton decays with the modes and 
rates predicted by(B—L)-conserving schemes of Grand Unification are not observed experi¬ 
mentally. There are reasons to believe that (B—L) might not be conserved in natnre, thus 
leading to the nucleon decay into lepton-l-(X) and to phenomena such as Majorana masses of 
neutrinos, neutrinoless double-beta decays, and most spectacularly to the transitions of neu¬ 
tron to anti-neutron. The energy scale where (B—L) violation takes place cannot be predicted 
by theory and therefore has to be explored by experiments. Different experimental approaches 
to searching for (B—L)-violating transition of neutron to antineutron are discussed in this pa¬ 
per. Most powerful search for n —> h can be performed in a new reactor-based experiment at 
HFIR/ORNL where sensitivity can be ~ 1,000 times higher than in the previous experiments. 


1 Introduction 


Our expectations for experimental observation of nucleon instability 0 are based on two out¬ 
standing ideas in contemporary physics: the need for explanation of barvpn asymmetry of the 
universe (BAU)B0 and the concept of Unification of particles and forcesufl. Presence of baryon 
instability in early universe is one of the components required □ for the explanation of BAU. 
However, BAU as an experimental fact does not tell us how baryon instability manifests itself. 
Particular modes of nucleon decay are predicted by theoretical schemes beyond the Standard 
Model (like Unification models) that yet have no solid experimental foundation. There is noth¬ 
ing sacred in conservation of baryon number. Even within the Standard Model, baryon number 
is not conserved at the non-perturbative level!. The latter non-conservation is very weak at the 
present temperature of the universe and does not lead to any observable effects. 

In spite of significant experimental attempts nucleon instability (other than regular /3-decay) 
so far hasLuot been discovered! suggesting further experiment^ efforts with increased mass of the 
detectorsis as well as the experiments in alternative directions^. One of such possible alternative 



experiments is a new sensitive search for neutron to antineutron transition0 that might explore 
stability of matter at a lifetime scale an order of magnitude beyond the reach of contemporary 
nucleon decay experiments. 


2 Why n 


n 


Let us discuss why experimental observation of n —> h transitions is important. In the baryon 
disappearance the conservation of the angular momentum (nucleon spin 1/2) would require 
at least one fermion to appear in the final state. A nucleon or leptons e, n, three neutrinos 
and their antiparticles are the only known fermions the initial nucleon can decay into. Two 
possibilities can be realized here: AB=AL or AB=—AL (B and L are the total baryon and 
lepton numbers respectively). The first possibility would lead to the conservation of (B—L) and 
second to the processes that violate (B—L) by two units. The most stringent nucleon decay limits 
are experimentally establishedBiS for nucleon decay modes where (B—L) is conserved such as 
p —> e++7r°,p —,p — +K^, etc. Experimental non-observation of these decay modes 
in IMB, Frejus, Kamiokande, Soudan II, Super-K experiments, and other experiui^entsQ excluded 
original SU(5), one-step-breaking SO(IO), and SUSY extended SU(5) models EJ. AlsOjrecent 
Super-Kamiokande resultsll^ almost rule out SUSY-extended SO(IO) proton decay modelll3. It is 
important to notice that in all these models, as well as in the Standard Model, (B—L) is strictly 
conserved at perturbative and non-perturbative levels. A new generation of experiments with 
huge-mass detectors! is needed to continue to test the stability of nucleons with respect to the 
(B—L) conservation. We believe that the search for the processes with (B—L) non-conservation 
will also need to be pursued by the future experiments on the equal basis. 

Why (B—L) might not be conserved? Naively we would expect that (B—L) number be 
strongly violated: the number of neutrons in our laboratory samples is in excess of equal number 
of protons and electrons. However, most leptons in the universe likely exist as, yet undetected, 
relic V and v radiation similar to cosmic microwave background radiation of photons. Thus, the 
conservation of (B—L) on a scale of the whole universe remains an open question. 

In nucleon decay (with nucleon disappearance AB=—1) non-conservation of (B—L) implies 
the existence of transitions of the type N —> lepton + X with A(B—L)=—2. The conservation 
of (B—L) in nucleon decays corresponds to A —> antilepton + X transitions. If (B—L) can 
be v iolated by two units, it is natural to assume, as also follows from the Unification models 
11SI13, that processes with | AL |=2 and | AB |=2 as well as the processes with AB=—AL are 
the components of the common physics coming from the same energy scale. Examples of the 
former two processes would be heavy Majorana neutrinos with | AL |=2 transitions of P 
and the transitions of n —> h with | A B | = 2; examples of the latter transitions could be 
processes p vne'^,n viyD,p etc. In Unification models of SO(IO) type, massive 

Majorana neutrinos with | AL |=2 transitions violating (B—L) byAwo units can generate the 
masses of conventional neutrinos through the “see-saw” mechanismEj. Thus, the explanation of 
the masses of neutrinos can be linked with (B—L) and B non-conservation. 

Since 1973, when (B—L) non-conservation was first considered theoretically!, it-V^ag-ilL 


cussed within the framework of Unification models in a number of theoretical papersEJoEJ 
In the left-right symmetric SO(IO) Unification models the violation of (B—L) arises simultane¬ 
ously at the same energy scale as the violation of left-right symmetry oEH. Thus, (B—L) non¬ 
conservation is related with the searches of the right-handed currents and Wr vector bosons. 
Present experimental lower limits for Wr mass are in a TeV range 0. If n ^ h transitions 
would be experimentally observed beyond the existing experimental limits it will point out to 
the energy scale of the L-R restoration much higher than a TeV. 

The n —> h transitions live on an energy scale ~10^ GeV. This scale follows from the 
dimensional reason: indeed, the disappearance of 3 quarks and appearance of 3 anti-quarks in 



n ^ n can be described as a Feynman operator of dimension 9 (each of six fermions brings 
to Lagrangian the dimension of therefore n — > h transition amplitude is proportional to 

M~^, where Mis the energy scale of (B—L) violation. Similarly, (B—L) conserving proton decay 
of the type p —> e'’'7r^ is described by the operator of dimension 6 and transition amplitude is 
proportional to M“^, where M is the unification scale. If the unification energy scale of SU(5) 
—10^® GeV would make p —>■ observable, the energy scale corresponding to observable 

n ^ n transition should be in the range of 10^ — 10® GeV. 

Could one expect a new ohysics at such “low energy scale”? The concept of Great Desert 
introduced by SU(5) model 0 was very popular for more than two decades. According to this 
concept no new physics would appear between electro-weak scale (or SUSY energy scale in 
the moclified concept) and Grand Unification scale of 10^® —10^® GeV. Recently it has been 
realized that unification of gravitational and gauge interactions might occur at much lower 
energy scale and in a way that preserves broken L-R gauge symmetry. Therefore, the energy 
scale of 10^—10® GeV might be a natural scale for existence of n —!■ h transitions. 

Probably the most compelliM reason for the existence of (B—L) non-conservation follows 
from the theoretical observation 113 that electroweak non-perturbative ’’sphaleron” mechanism in 
the early universe would erase the observed BAU if (B—L) is globally conserved. Therefore, it 
is natural to assume that (B—L) non-conservation takes place at the energies above the electro- 
weak scale. In this sense, experimental discovery of the nucleon decay into ’’standard” decay 
modes like p e'^ir^ or p —> with conservation of (B—L) would leave BAU unexplained. 

As was pointed out by Gell-Mann and Pais in 1955 E3, the only conservation law of nature 
that would forbid the n —> h transition is the conservation of baryon number. In 1970, n —> 
n transition was considered by Kuzmin as a possible explanation of BAU0. In the 1980s, it was 
suggested hv Glashow in the context of SU(5) models 0 and independently by Marshak and 
MohapatraM in the context of left-right symmetric models that n —> h transition could lead 
to theoretical schemes complementary or alternative to those exploiting the (B—L) conserving 
proton decay mechanism. In particular, Marshak and Mohapatra pointed out that there is an 
intimate connection between a non-vanishing Majorana mass for neutrinos and a possibility of 
the A(B—L) =—2 in n —> h transition. The recent experimental indicationsc3 for the existence 
of neutrino mass therefore strengthen the case for a new dedicated search for n —> h oscillations. 

The question of the energy scale where (B—L) violation manifests itself is an experimen¬ 
tal one. New experiments searching for n —> h transitions might answer ib Several recent 
theoretical works provide encouraging motivation here. In the recent paper Babu and Mo¬ 
hapatra predicted in the context of a wide class of SO(10)-based left-right symmetric neutrino 
mass seesaw models the upper limit for the appearance of n —> h transitions that is within the 
sensitivity range that can be reached by the next generation n —> h search experiments. Nussi- 
nov and Shrocko have analyzed the n —> h process within the scope of generic models with 
large extra dimensions in which standard model fields propagate and fermion wave functions 
have strong localization. They found that in these models proton decay can be suppressed but 
n —> h transitions might occur at the levels not too far below the current experimental limits. 
Dvali and Gabadadze^ discussed how global charges can be violated in the extra-dimensional 
models with low quantum gravity scale. In their approach the Standard Model particles are 
localized on the brane, which is a fluctuating object. Due to quantum fluctuations, there are 
following virtual processes occur: brane gets curved locally and creates a bubble (’’baby brane”) 
which gets detached from the brane and goes into extra dimension where it effectively becomes 
a black hole, then reenters again on the brane and decays there. Baryon number can be violated 
inside the black hole due to quantum gravity effects. The baby brane can take away any particle 
with strictly zero gauge charge, such as a neutron, and return back any other combination of 
the same mass and spin, for instance, anti-neutron. On the brane this process will be seen 
as n —> h transition. The same process cannot lead to the proton decay, since the charged 



particles cannot leave the brane, because the photon is localized there. The amplitude of the 
n ^ n transition depends on the parameters such as fundamental Planck mass, brane thickness 
etc. For reasonable values the effective operator comes out to be suppressed by the scale r\j 10® 
GeV. 

3 Experimental searches for n ^ n 

Observation of n —> h transitions would be the most spectacular manifestation of the new 
physics, if such physics exists at the energy scale around 10^ GeV. Let’s assume that the am¬ 
plitude of n —> h transition given by this mergy scale is a. Then , the transition probability 
of n —> h for free neutrons can be found tJ from the solution of time-dependent Schrodinger 
equation (|I]): 




dip 

in-— = 
dt \ a 



( 1 ) 


where ip describes a 2-component neutron-antineutron state, En and E^ are non-relativistic 
operators of total energy for neutron and antineutron respectively. Probability of neutron to 
antineutron transition in the absence of external fields different for neutrons and anti-neutrons 
can be then found from (ED as Pnn = {t/Tnn)^ where Tnn = ^/ct is a characteristic transition 
(oscillation) time. 

Previous experimental searches i for n ^ n transitions have been made (a) in vacuum with 
free neutrons from the reactors and (b) with neutrons bound inside nuclei. Sensitivity or discov¬ 
ery potential (D.P.) in experiments with free neutrons can be defined as a product of a number 
of neutron flights per second and the average square of the neutromflight time in a free space 
or between two collisions with walls. In the state-of-art experimenth®! performed by Heidelberg- 
ILL-Padova-Pavia Gollaboration at HFR reactor with cold neutron beam at ILL/Grenoble the 
discovery potential of 1.5T0®n • s have been reached. After approximately a year of beam expo¬ 
sure it resulted in the limit for free-neutron n —> h transition time of Tnn > 8.6 x 10^ seconds. 

In intranuclear transitions n ^ n probability is suppressed 0 by the presence of nuclear 
potential in (|l|) that is different for neutron and anijneutron. This suppi^sion under reasonable 
assumptions can be calculated by nuclear theorywith an accuracy^ of about factor of 2. 
Gorresponding intranuclear lifetime is given by 


T(intranuclear) = R ■ T^^(/ree) 


( 2 ) 


where R is dimensional ’’suppression factor” equal to ~ 2-10^^sec“^ for the most of nuclei 
0. The order of magnitude of intranuclear suppression can be qualitatively understood from 
the following simple considerations. The neutron bound in nucleus by energy AE (~10 MeV) is 
quasi-free for the time At ~ 1 /AE or ~10“^^sec. Probability of n ^ h transition during the time 
At is (At/r^fi)^. This condition occurs 1/At times per second. Then r {intranuclear)=Tnn/At. 
One can see that 1/At ~ 10^^ sec~^ plays the role or suppression factor R. This factor is 
different from more carefully calculated factors inEZI by only 1-2 orders of magnitude. 

Most stringent limit in the intranuclear n —>■ h transition search was provided by Soudan 
2 Gollaboration El. Their limit for iron nucleus lifetime with respect to intranuclear n ^ 
h transition is Tpe > 7.2T03^ years. This according to (D and intranuclear suppression factor^ 
corresponds to free neutron oscillation time Tnn > 1-3 x 10® seconds. Intranuclear n —!■ n search 
also is being pursued by Super-KE3 and SNOuU collaborations. It is expected E3 that limits 
reached by both experiments will be in the range of Tnn > 4 x 10® seconds. However, since their 
observations will be limited by the atmospheric neutrino background (0.7 z/’s per kt-year in 


Soudan 2 experiment) further improvement in Tnn will be proportional to (kt-year)^/^. Interest¬ 
ing that SNO sensitivity is close to that in Super-K althongh SNO detector mass is much sm alle r. 
This is mainly dne to order-of-magnitnde smaller nuclear suppression factor for denteriumcZI. 

From the comparison of free-neutron and bound-neutron techniqnes one can clearly see 
the advantages of the experiments with reactor neutrons: an order of magnitude improvement 
in the sensitivity of experiment with free nentrons is equivalent to two orders of magnitude 
improvement in intranuclear search. Presently both methods give approximately eqnal limits. 


Recent progress in increase of 
for n ^ n transitions with UCN 


roduction of ultracold neutrons allows one to plan a search 
:3. Sources of ultracold neutrons are being constrncted or 
planned at LANL, PSI/Znrich, FRMII/Miinchen, in Japan, at North Carolina State University 
reactor, and at Indiana University compact nentron source. The UCN production rate at some 


of these sources is expected to exceed 10' With UCN production rate of ~5T0'^s“^ or higher 
and with assnmption that detector can be made backgroundless it will be possible to reach the 
discovery potential D.P. >4T0^*^n • s and therefore search for n ^ n transition np to the limit 
of ~ Tnn > 10®S. 

The maximum sensitivity for the n —> T search is provided by use of intensive cold-neutron 
beam from the high-flux research reactorsll3. With the presently available technology (focusing 
neutron reflector and cold nentron moderator) and with existing sources of neutrons (e.g. HFffi 
reactor at ORNL with the world highest thermal flux of ~1.5T0^^ n-cm“^-s“^) it is possiblell3 
to reach sensitivity D.P. >6T0^^n • s and search for n n transitions np to and above the limit 
of Tnn >3T0®s. This sensitivity (i.e. time integrated probability of antmentron appearance) 
is 1,000 times higher than in Heidelberg-ILL-Padova-Pavia experimenlE3. The experimental 
signatnre of appearance of antinentron in the cold-energy neutron beam wonld be imambiguous 
and backgronnd free as was demonstrated by the ILL/Grenoble-based experimented. The n —> 
n oscillation time limit that could be reached in a new HFIR-based experiment would correspond 
to intranuclear lifetime limit of ~ 10^® years, which exceeds significantly the sensitivity for matter 
instability search in Super-K. 

Present n —> h limits and future sensitivity reaches for different experimental techniques 
(cold neutron beam, UCN, and intranuclear) are compared in Figure [T|. Conceptual layout of 
cold-neutron beam experiment at HFIR/ORNL reactor is shown in Figure ||. 

Figure ^ shows cross-section of the HFIR reactor at ORNL where n —> h search experiment 
can be implemented at HB-3 beam line equipped with a new cold neutron moderator. 

One can show, ignoring the effect of gravity, that the probability of observation of antineutron 
in the experiment with optimized focusing reflector is proportional to D.P. r\j I? where 

L is the distance between the point of reflection and the annihilation detector and T is an 
effective temperature of the thermalized neutron spectrum. This should be compared with the 
discovery potential for the layout without the focusing reflector where D.P. r\j I/ri/2. Thns, 
with the advanced layout the large length of the experiment and the low temperature of neutrons 
would result in snbstantial increase of the discovery potential. More comprehensive Monte-Carlo 
simulations inclnding gravity effect 113 show that discovery potential of HFIR-based experiment 
with cold supercritical hydrogen moderator 0 in HB-3 beam pi^ (see Figure can be more 
than factor of ~ 400 higher than in ILL/RHF-based experimentcH. Thus, one day of operation 
at HFIR in the new proposed n ^ n searchkJ is equivalent to one year in the previous ILL/RHF- 
based experiment. Table |I| compares essential features of the new-proposed HFIR experiment 
0 in HB-3 beam port with the ILL/RHF-based experiment 

The conceptual scheme of the antineutron annihilation detector in the new experiment can 
be similar to that nsed in the previons Heidelberg-ILL-Padova-Pavia experimentcj. Annihilation 
target is a thin carbon-film membrane with almost 100% efficiency for antineutron detection and 
with low efficiency for (n ,7 ) conversion. Final states of nucleon-antinncleon annihilation are well 
understood mainly dne to the LEAR studies and can be acenrately modeled 123. Average final 



Figure 1: Comparison of free-neutron and bound-neutron methods for n ^ n transition search. Horizontal 
scale: limits for characteristic transition time in experiments with free neutrons from the reactors. Vertical scale: 
limits for lifetime for intranuclear n —> n transition in nucleon decay experiments. Two methods are related by 
theoretical “nuclear suppressed” dependence [27] as explained in the text. 


HFIR 
Reactor 
100 MW 


neutron 

source 


Focusing 
Ni-58 reflector L ~ 200-500 m 


Detector 



Annihilation 
target 
2 m dia. 


Figure 2: Conceptual layout of cold-neutron beam n ^ n search experiment with focusing reflector for 

HFIR/ORNL research reactor (not to scale). 
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Figure 3: Section view of ORNL/HFIR reactor core. In the n ^ n search experiment the cold supercritical 
hydrogen moderator should be installed in the HB-3 beam tube. 


Table 1: Comparison of the major parameters of a new n —> h search experiment proposed for HB-3 beam line 
at High Flux Isotope Reactor at Oak Ridge National Laboratory with the previous n —> h search experiment 

performed in 1989-1991 at RHF Reactor at ILL/Grenoble 


Neutron source 

RHF / Grenoble 

HFIR/ORNL 

Reference 

[26] 

[35] 

Status of experiment 

Completed 

Proposed (HB-3 beam) 

Reactor power, MW 

58 

(85) 100 

Reactor’s peak thermal n-flux 

1.4 10^® (n/cm^/s) 

1.5 10^^ (n/cm^/s) 

Moderator 

Liquid D 2 

Supercritical H 2 

Source area 

6x12 cm^ 

~ 11 cm diameter 

Target diameter 

1.1 m 

2.0 m 

Flight path 

76 m 

300 m 

Neutron fluence at target 

1.25-10^^ n/s 

~ 8.5-10^2n/s 

Average time of flight 

0.109 s 

0.27 s 

Detector efficiency 

0.48 

~ 0.5 

Operation time (s) 

2.4-10^ 

7-10’^ (~3 years) 

Discovery potential per sec 

1.5T0® n-s^ 

6.2-1011 n-s^ 

Tnn limit (90%CL) 

8.6-10^ s 

3.0-109 s 










state has five pions originating in the annihilation target. Tracking part of the detector should 
reconstruct the candidate event vertex and verify its position relative the annihilation target 
origin. A calorimeter can be used for triggering and for the total energy deposit measurement 
(below ~1.8 GeV). Detector should be surrounded by cosmic veto scintillator counter system to 
reduce the trigger rate and to remove the possible cosmic ray background. 

Quality of the ®®Ni coating of the focusing reflector does not need to be as perfect as in the 
case of conventional neutron guide mirrors and super-mirrors since neutrons undergo ^sentially 
only single reflection. Vacuum in the flight tube should be better than 10“^ Pac3. Earth 
magnetic field that would suppress the n ^ n transition must be compensated diovn to a level 
of few nano-Tesla in the entire flight volume. Following the recommendation ofE^ both active 
(compensating coils) and passive (permalloy) screens should be used to achieve required field 
compensation. An active magnetic field compensation system provides cross check by “switching 
off” the effect in the case if antineutron signature is observed. 


4 Beyond the existence of n —> n 

It was pointed out in paper 0 that the existence of n ^ n transitions would provide a unique 
opportunity for testing CPT-theorem by looking at the mass difference Am of neutron and 
antineutron. Suchmass difference (or similarly a small gravitational non-equivalence of neutron 
and antineutron) 123 will suppress the n —> n transition for free neutrons but will be too small to 
produce a sizable additional effect in intranuclear transitions where a very large suppression is 
already present due to significant difference of nuclear potentials for neutron and antineutron. 
Therefore, two measurements are required: one with free neutp^ns in the reactor experiment 
and the other with bound neutrons in intranuclear transitions 123. The latter experiment can 
be replaced by a reactor-based measurement with a controllable variation of the magnetic field. 
Since the ultimate sensitivity to Am of the reactor-based experiment is Am < h/At, with a 
neutron flight time At ~ 0.3 sec (for HFIR-based experiment), the smallest achievable value of 
Am/m can be few orders of magnitude lower than mn/mpiank- 


5 Conclusion 

Reactor search for n ^ n transition is a very sensitive method of observation of (B—L) non¬ 
conserving processes. Proposed new experimental approach to search for n —> h transition at 
research reactors with cold neutron beams might result in an equivalent experimental limit of 
IqSS years for intranuclear stability of nucleon. Such limit is not attainable by any other existing 
experimental method. 

Physics at the energy scale of 10^ — 10® GeV might be dominated by quantum gravity effects 
that could be manifested through re —> h transitions. If re re transitions are observed, it 
will reveal a new phenomenon leading to a new physics at the energy scale beyond the range 
of colliders. New symmetry principles determining the history of the universe during the first 
moments of creation might be established; the left-right symmetry, broken in the Standard 
Model, may be found restored. The discovery of re re transition would provide a major 
constraint on unification models and contribute to the understanding of baryon asymmetry of 
the universe. If and when such phenomenon is established, the subsequent experiments with 
re —> re transition should allow a most precise test of CPT invariance and/or gravitational 
equivalence of baryonic matter and antimatter. 
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